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ABSTRACT 

This paper on longitudinal/intervention research is 
divided into a discussion of the problems of this strategy and a 
working paper. Many of the problems are practical ones, concerning 
the uncertain trends of funding and the drifting of goals and 
priorities; all of the Methodological problems and inadeguacies of 
longitudinal research and intervention evaluation are considered, as 
well as some new and unique problems. These include (1) variation in 
schedules of intervention (periodic or continuous) , (2) same 
intervention over time or different sequences, (3) comprehensive or 
specific intervention, (U) latent effects of programs, (5) problems 
in determining predictors of performance and in identifying the 
precnrsoirs of present performance, and (6) the interpretation of 
changes over time after termination of intervention. The second part 
of this document is a working paper prepared from interviews with 
agencies belonging to the Interagency Panel, The content of the 
interviews emphasizes the choice of research strategies and methods 
of implementing cooperative programs of longitudinal/intervention 
research. Results are discussed in general terms, although responses 
of individual agencies are reported in an appendix. (DP) 



OOCuVCNf HAS BEEN fttPftft 
p^CfD CXACr.v *S iECE.vEO >OC?A 



A STATEMENT AND WORKING P^\?ER 
ON LONGITUDINAL/ INTERVENTION RESE;ARCH 



Prepared for 
The Interagency Panel on 
Early Childhood Research and Development 

by 

Edith Grotberg, Ph.D. and Ellen Searcy, M,A, 



Social Research Group 
The George Washington University 
. Washington, D.C, 

Grant Num^.er CCD CB 107 



April 21, 1972 



ACKNOWLEDGEMENT 



Thanks is given to Joyce Lazar whose Preliminary 
Re£oYt on the Prese nt Status and Fu ti^eJ^PPH^ 
-?^£Ii£itudinal^^ 

and_penonstratton was used as a reference in the 
preparation of this report. 

\ 

Edith Grotberg, Ph.D. 
Ellen Searcy, M.A. 



TABLE OF CONTENTS 



Part Page 

I Problems Encountered in Longitudinal/Intervention Research., .1 

Problems in Longitudinal research,., , ,«.•..•.«.•.,• 2 

Problems in Intervention Research ,•.«« 6 

Problems in Longitudinal/Intervention Research,,.. . 9 

II Working Paper Prepared from Agency Interviews Relating to Longi- 
tudinal/Intervention Research , < , 12 

Summary of Content Sought in Agency Interviews 13, 

Summary of Agency Responses to Interview Questions * lA , 

Tentative Research Plans Suggested by Agency Interviews, 

Presented for Consideration by the Panel ,,, 17 



-Appendices 

A - Working Papf^r, Summary of each Agency Interview 

B - Interagency Panel Materials Prepared to Assist In Planning 
a Joint Research Effort 



ERLC 



1. 



^ ?Ili£li!5Ji!l£rjl'"^ ^'££££L li} ^Ainj yiCudf n al / I n t orv on tion Ho s c a r c1 1 

A new thrui^t In research in early childhood development focui?es on 
longitudinal/intervention studic^s. Research results > particularly since 
the massive social legislation of the mid ^60 's, consistently point out 
the problenis. of jilvort-term intervention activities where the positive 
Impact of the sliort-term intervention is generally lost over time. These 
' problems have . caused agencies to re-examine some of their research activi- 

ties to determine if there are more effective ways to study the problems 

of intervention. One way reelected is the longitudinal/intervention approach, 

c 

The Interagency Panel on Early Childhood Rer^earch and Development 
is engaged in formulating some ways to address the longitudinal/inter- 
vention problems. It has selected two major approaches. One is to look . 
at on-going longitudinal research in terms of how it might be used as a' 
base for adding interventions, shifting intervention studies to a longi- 
tudinal design or making use of already on-going or planned longitudinal/ 
intervention studies. The second approach is to begin de novo with a 
longitudinal/intervention design. 

Initial efforts to look at longitudinal/intervention research on 
an Interagency basis> building on what already exists^ comprise the latter 
portion of this document. However, it is Important, first, to highlight 
the problems peculiar to longitudinal /intervention research. Many of 
these problems are of a practical nature. These include the following 
facts about longitudinal/intervention research: 

1. It is expensive. 

2, Money is tied to goals of the incumbent Adm.iuist ration which 
' \ change and affect allocation of research dollars. 
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Honey is tied to gonJs of tlic ap,oncy. Agency goals sliift 
to reflect goals and priorities of the Administration and 
of the Congress. 

The Administration, Congress and agency heads like tb see 
immediate and tangible results of investment of rGsear<:h 
dollars ~ tliey do not Understand the "nature^' of longitudi- 
nal research. 

Program manigers or project officers sometimes have favorite 
research areas or researchers whicli can tie up money. 

Large turnover 6f^ program administrators and managers^ 
especially now in Federal agencies^ interrupts continuity. 

Investigators themselves lose interest after a few years and 
have often received little recognition for work in longitudi- 
nal research . ^ 

The above means projects may break up before yi3lds are in, 
that feasibility and usefulness in actual situations are not 
adequately demonstrated. 

Other problems concern longitudinal research per se, some concern 
intervention research and some concern the combination of longitudinal/ 
intervention research. This section will deal with each of these problem 
areas. 



Problems in Longitudinal Research 

The major value of longitudinal research in child development Is 
the information provided which reflects changes in behavior over time. 
In other words, changes in each subject may be identified in a descrip- 
tive manner without necessarily attempting to state cause-effect relation- 
ships; rather the sequential relationships of child development may be 
described. The research technique generally used for this kind of 
descriptive longitudinal research is observation. Longitudinal studies, 
so defined may include normal or handicapped child7;en, may include cliil- 
dren from different ethnic groups, different regions, and different 
O socioeconomic groups. The same goal for the longitudinal studies cuts 
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%3cross tho popiilatioits ; i.e. the description of devGlopmenta] change;' 
over time. iJo e:^ierinx'nLal ip tcrvoulions arc studied in this kind of 
research. ' 

Long term stiultos whicli follow" the development of children over 
xutiny years must deal witli a,i>iJTnber of difficulties, however, not Uiv. 
least of whicli is continued stable funding. Among these difficultH s 
are : 

!• Researcli design 

Research design may well be too linited in that the focus is 
restricted to the physical or psychological development of chil- 
dren, ignoring their sociali2ation development. Often, too, it 
is easier to describe the development of the child as though he 
. were not an interacting creature . Tlius the relationships and 

interactions with persons and objects arc often ignored. Then, 
over time, there is a shift in interest or focus of development. 
For example, much more emphasis is currently placed on exploratory . 
behavior and motivation than was true ten years ago. Longitudinal 
studies might well become outdated as new interests or indeed new 
knowledge suggests changes in research design* 

2. Sample problems 
S ize of s ample; 

Because of the amount of data collected on children as v;ell 
^ as the funding, samples have generally been too small to allow 

for mucVi generalization. 

Representativeness of sample: 
Q Long term studies have rarely been able to obtain representative 
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sainplcs in spile of efforts 'to overcome this limitation* For 
the inosl part, data from lonp,itudinal studios are on v/hite 
middle class children vhoso parents are interested enough in the 
research jirojecl to continue to take part in the prop^ram^ and 

s 

who live Iclose to a major university or research center, 

1 - .... 

Attr i tion of the sam ple; 

Shrinkage of already small samples occurs over time because of 
a loss of rapport between the researchers and the family » or 
because of mobility (one American family in five moves every 
year)* 

The effects of continued observation and testing 

Effects in long term studies Include Observer effects, the Hawthorne 
effect > and an increaslnp^ awareness and greater capacity ^mong Sub- 
jects to observe and report. As years go by, the sample may become 
Increasingly different from a control group primarily because of 
participation in tlie research situation* 

Continuity of staffing 
Commi tnien t .* 

For a principal investigator to commit himself to life-span 
observations necessitates an on-going dedication to one 
particular area of research, and the likelihood that the inves- 
tigator v/ill not live to report on the final stages of the 
investigation • 

Continuity : 

If the principal investigator leaves the project, there may be 
a shift of focus or interest when a new principal Investigator 
takes over* It is also difficult to keep staff at other levels 



for very long studies. This raises problem^>4^ of observer 
and/or tester differences. 

' 0 

Testing pror.cdures 

0 

Testing ^cliedules : ^ ' 

Every longitudinal study must face the dilemma of choice 
between fixed and flexible procedures over a span of years. 
On fixed schedules, children are ill or on vacation and can- 
cxoM be observed as scheduled. 

Instrum ent r o v i s 1 on: ^ ^ 

As years pass /n^ieasurements and evaluation instruments are 

revised or new instruments developed. A chpice„ must be made 

between continuing with the instrument initially used, or 

shifting to improved or new measures. 

^/^ ' - 

Data processing 

The mass of data collected always presents problems in data process 
ing, and decisions must be made as to what to process. Improved 
data processing methods over the years as well as new statistical 
procedures present both new opportunities and new dilemmas. 

Environmental ^changes 

Subjects in longitudinal studies are influenced by both national 
and local changes in the environment. Major events such as war 
and depression may exert both unmeasured or unmcasurable Influences 
Shifts in cultural mores, social attitudes and values may do the 
same. Of even more significance, local environmental changes may 
affect the test sample in such a way that they "may differ greatly 
from a tjlmilar sample in the larger population. Great local 



disasters such as oarthqtinkcs and floocls> as wtll as high local 
unemployment I are examples of such environmental changes. ^ * 

• ■ ■ 

P roblems in Interv ention Research 

'* 

/Tiie major value of intervention research is to effect ^change where 
the change agent or treatment is identified and coUtrolJ.ed. This kind 
of research provides infonnation helpful in enhancing the development 
of chll'dren, correcting defects in that development , or indeed prevent- 
ing defect?. A number of problems, however, prevail in intervention re- 
search. These are described below. . - 

1. Interpretation of gains or losses on test performance 
Te st m otivation: 

The changes In scores on tests may be the result of familiarity 
with^fehe test situation, rapport between the child and the 
examiner, the willingness to try certain items in the tost, and 
the importance placed on good test performances rather than 
changes in ability as a result of intervention. 

Test biases ; 

. , Tests tend to operate on the continued assumption that children 
have been exposed to the same general experiences. This assump 
tion mitigates against children from other than main-stream 
American middle class families and test scores are accordingly 
» affected , 

♦ 

Regression plienomena i 

Test scores above the mean on pre-test administration tend to 
lie closer to the mean on post-test administration. Likev;ise, 
^, test scores below the mean on pre-tcst administration tend to 



bo closer to the mean on post-tost admini^3tratlon . The effect 
is to indicate a loss or iinprovcinent by tlio initial high or low 
scores wlien ii\ fact a statistical and measurement artifact is 
operating. , 

Methodological problems 

Sampling : » 

Intervention studies using large population samples have diffi- 
culty establishing the' parameters of the intervention components 
as well as difficulty establishing control groups. 

Age of interv^ention t 

Differences in kinds of intervention .and measurements of effects 
of intervention 'vary with age, Tlius , tests for children between 
the ages of 18 and 36 months of age have more sensory and motor 
items while tests for children 3 to 6 have more language items. 
Tbe intervention program may or may not reflect this shift in 
emphasis and test scores arc accordingly affected. 

Length of inter v entio n: 

Problems confounding the determination of the effect of time 
in an intervention program include the tendency to make initially 
rapid gains with a slowing of the rate of Increase, and for 
children from low-income families and poorer schools/ the cunt^- 
Ivitive deficit phenomenon* Maintaining a lr.vel of per f ortjiance 
may indeed be progress to the extent if breaks the cumulative 
deficit . ^ , • 

Individ ual and group dif ferences : 

Intervention programs tend to. deal with group means rather 

than analyzing data to determine effects based on sex, etlmlcity, 



culture, religion ana race. ♦ V ' 

I < , 

Kind of iutorvention ; t - -^ * ' 

' * / * c * . . , \ . 

Intervention effects may be Jiiislqadi n^. to t^e extent the , . 
intervention program is geared to^ the*^ 'tests detci^mining * 
. effects of intervention. The more structured" the^ program/ 
the jnore .th6 goals are ob:lettive3,y exY^ressed^ the n^ore , ' 
they .are consistent with rtest items, the greater *the appar-^nt. 
impdct of thc^ intervention program. Programs that encourage 
exploratory behavior of children, stimulate creativity, and 
self-expression are more difficult to quantify aitd* thcrcforfe 
evalv\at'e by. use of standardized measures* The result Is that 
s6ructured programs may well be overvalued as ef'fectivc' vhlle' 
.less structured programs are undervalued. ^ 

Evaluatio n of^ i ntervention; ' \ ^ • -r^ 

Evaluations tend to assess how <nuch change, occurs '^s'" a iv^^ult 
of progranf intervention rather than what kinds of fehanges', ^ 
bccur. As sooT)\as programs address themselves to what kinds 
of changes ai'c dcsir-able, they face the problems *of determin- 
ing what skills or learning s,tyles are lirioortant to^ plater 

• . J ^ 

. developmdnt* ' .Further, they ar^ f aced*:^wi»th the pCtoblem of , 

establishing p-rogram goals\ and ass-igning priorities ai^iongvthern 
These things have not been .dene. wl tlt'^ny genera] agrcerCent or 
' s^atlsfaction. ^ • * ' * • 



Sources of effects other thaf)-! n t o r ve n t i ons > / ^ 

' .'Intervention programs tend to bij .as'sessed indep/>-nde>it of 

- . / * , . I ^ * V 
^family» physlical, and comi^umlty .*s*et tings • • Thd^fallaciOusnft'ss 

of this procedure IS made clear In^a l^r.w ettidicaV exaliple, 



tlio lancuagc usa^',G of mothers with tlieir children was- proved 
to be a more forceful determinant of the childrcn'r. achieve-- 
ment behavior than income level or prograra i,ntrrventibn.< Programs 
have generally not looked at the broader^societal cont.ext, for 
sources/'of effects on child development. 

Prohle ins in Longitud inal/ Interv ention Resear ch 

All the problems of botli longitudinal research and intervention 
research exist in longitudliial/intervention research; however some 
new problems unique to longitudinal/intervention studies need to be 
higlilighted. . 

1. Continuous intervention or periodic intervention. 

No one has looked at the relative value of providing intervention 
progrni^s on a continuous basis over time compared to determining 
at what times and in what forms intervention should occur. The 
problems of maintaining contact with and deriving information on 
experiences ""of groups receiving periodic intervention^ between the 
intervention phases, complicates the researcli dif f iculties • 

2. Same Intervention over time or different sequences of intervention.* 

Is it possible in* mobile and uncontrolled social and educational 
systems to keep a child in the same intervention program over time 
or to determine v^;hat sequence is most beneficial to him when there 
Is no assurance he will be able to remain in the program or the 
sequence? Some available data suggest the benefits and disadvan- ^ 
tages of certain sequences and certain programs but" the problems 
of stability of population and programs persist. ^ , 
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3. Comprehensive intervention over time or specific intervention. 



The problem of cost-benefit is prominent in determining the relative 
advantages and effects of total intervention on a comprehensive 



scale or specific intervention on targets of diagnosed need or 
assumed need. Another probxcm related to this concerns the advaa- 
tages of comprehensive or specific intervention for different age 
groups in different population groups. 

^. Latent effects 

Occassionally an effect sought from an intervention does not demon- 
strate itself untijl a consideral)le period of time after the inter- 
vention. Short-term effects o| intervention, then, may be as misleading 
as long-term effects. Ways to- solve these problems in terms of re- 
search strategy dp not yet exist* 

5, Predictors and precursors 

Not only are there problems in deteriT^ining the predictors of recent 
performance to future performance, but there are also problems in 
identifying the precursors to present performance. Longitudinal/ 
intervention research needs this kind"' of information to be meaningful, 

6, Interpretation of changes over time after terminating intervention. 

The problem persists in knowi^^ig how to explain the measured losses 
or gains after intervention has terminated. Some explanations 
include: (a) the intervention had no real effect on the child but 
. only an illusory and temporary one showing up on tests; (b) the 
subsequent experiences may reinforce or indeed co^ntravene the Intcr- 
O venticns: (c) the home experiences may reinforce or contravene the 
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,■■ . ■ . , 11. ■ ■ ■ 

long enough duration; (e) the intervention changed the wrong 
tliinf.s; and (f) the poor p.ronp in the classroom or the teacher 
in the classroom reinforced or contravened the effects of the 
intervention ♦ 

Even recognizing all of these problems peculiar to longitudinal/inter- 
vention research, such research is imperative and tlie problems must be 
resolved. The Interagency Panel on Early Ciiildhood Research and Develop- 
ment has examined past, current and planned r^seai^ch of tlic member agencies, 
and suggests a possible coordinated effort in longitudinal-intervention 
research. The possibility of designing longitudinal/intervention research 
separate from agencies or current activitiesHs still available as a 
choice. The Panel may address itself to that choice as considered desir- 
able , 
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Kelatinp. 10 Long'i Uulinai/lnLorvontion Kr.searcli 

In olrder to obtain additional Information with v/hich to proceed 
with the i>lanning of a joint early childhood reseatch effort, the mem- 
bers" of the Interagency Panel on KarJy Childhood Research and Development 
: were ii|tervic\/ed following tlie last Panel meeting* With regard to the 
question as to whether the better procedure for the "planning of a coordi^ 
natcd research model is to start with already funded research, or with 
a new design, tlie consensus was that an approach combining the tv;o' pro- 
cedures is needed. That is, a new design should be developed which draws 
upon the results of past and ongoing research and is related to or 
Cf jrdinated with ongoing studies whenever possible. New work should 
be contracted out for particular pieces of research only when the plan 
indicates there is a need for new efforts. Thus, most of the questions , 
listed in the Working Paper (Dr. Grotberg, 2/28/72) relate to this 
conceptualization and were included in tlie interviews. These appear 
translated into statements on the next page* 

The time lintits of the interviews prohibited obtaining detailed 
answers in all areas from all individuals. Tliis is true particularly 
for items four and five> on the next page, for which examples only of 
significant cases were given. However, more detail on these and otiier 
items can be obtained in later planning stages as deemed necessary. 
Thus, the information from each agency which follows sliould be considered 
as indicating only some of the possibi li ties for a joint researcli effort 
and not as complete and final. Each agency will be provided 
opportunity to change or expand any item and the paper will not be 
O , distributed to other th^n Panel menbers. It is a Working Paper pre- 

ERJC 

pared for Panel use* 
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SumIl}aric^5 of the information soiiglit nnd the replies are given 
below* The responses of individuvTl agencies to Llie qucs»:ions are 
contained in Ay)pendlx A. A list of titles of other materials pre- 
pared by the Secretariat to assitJt in tjie planning of a Joint longi- 
tudinal/intervention researcii effort appears in Appendix B» 



Sumary of Content Sou ^.ht in Agenc y Int erviews 

1, The other agencies it is appropriate for any one agency to work 
with; kinds of lielp needed from other agencies, 

2, I.inks in agency research that could he made v^ith basic (or applied) 
research, 

3. Research areas of most concern in the agency which may be suited 
to study in a joint project. (Includes gaps.) 

4, Present projects of the agency wlilch might be useful in organiii- 
ing a coordinated longitudinal/intervention study. 

5. The agency data presently available that could be useful for 
planning longitudinal/intervention research. 

6. Possible methods for synthesizing the various agency inputs into 

a viable longitudinal/intervention research design (conceptualiza- 
tion and planning.) 

T^, ' The kind of structure that might be set up to launch and/or main- 
tain an interagency longitudinal/intervention study. 

8. Th<i contribution an agency might mak^^ to an longitudinal/intervention 
research design in terms of agency strengths, interests, and priorities. 

9. Suggestions regarding instrumentation for assessment. 
10» Funding procedures for joint longitudinal funding. 

II. The problems involved in conducting longitudinal research. (Included 
in preceding section on Problems.) 



Sj^iinniarj^' j:>f A^^mi^v ]j(^s|>c3n.ses to "hit "rviex^^ j^^"^ ^ 

a. Loagi tiKlinal research Is necessai-y in order to obtain undersLanding 
of the developmental processes in cliildrcn, 

b. Developmont of effective interventions must bo a long-term process 
which syntherti/.es fi tiding about all the aspects of child develop- 
ment and A/nat influences it* 

c. A possible design for the joint effort was conceived as related to 
the development of the child over tiir.e, including basic researcli 
findings and going through the implementation phase: a joint 
longitudinal research effort should include data from basic research, 
demographic studies and policy research, as well as the development, 
testing and implementation of the intervention. 

^ d. It was suggested tiie overall design should consist of individual 

. components or segments of ongoing and new work, and indicate which 
" agencies are the most appropriate to fund" tlie various segments. 

e. Specific agencies (BKfi, NICllD, NIMH) would like a broad joint effort 
to include study of the physical and mental health of the disturbed, 
retarded and otherwise handicapped children. 

1 ' Other Agencies ^ 

, Three agencies OASPE, OCD and OE (through its component agencies) 
have theoretical linkages with all other agencies. The UE bureaus 
and programs are linked together by a concern witli the education of 
children. ^ The other alignments occur along health and welfare jgroup- 
ings, i.e., NIMH, NICHD, MCllS and Bl^H, or through the disadvantaged 
population. Literally all of the agencies have research focused on 
the disadvantaged with sev^eral agenceis including such research as 
a primary part of the research program, i.e., GEO, OCI), SRS, Follow 
Tlirough, 

2* Basic/Applied 

Much of the basic research Jins a practical aspect; the applied research 
can serve as a testing ground for basic findings. 

3. Areas of Interest 



Each of the developmental processes and the interrelationships of 
the developmental processes; the v:hole child* Tlio effects of the 
total milieu of home, family, school, peers, institutions, etc. 
Spe^cific agencies otiier than tlie former tliat were mxnUioned by more 
than one agency are the disadvantaged child, the liandi capped child, 
nutrition', del ivery systems , teenage parents* . 



This area needs to be devoloDod by further exmainatlon of the pro- 
ject'lnforincition contained in the various backp.round papers prepared 
by the Secretariat, and updated with FY * 72 data. Small group 
ncetings of Panel mcnibers may also lielp select ongoiiig project wliich 
could become componentj; of a joint agency effort. 

Data 

This section needs exptinsion also. Some of the examples given 
are of special significance, especially perluips the willingness of 
Follow Tlirougli to make its entire evaluation data base available 
to thd Panel free of charge. 

Pl£mninj> 

a* Panel working in subgroups sliould discuss contributions they 
can make and then develop project objectives and guidelines. 

b. Planning of the design and impleaientation of the project should 
be contracted out. 

c. The project should begin with studies to determine what already-* 
available information may be used (nonfederal as well as federal) 
and to sumn^ari^e what interventions have been found to be effec- 
tive in promoting child development . 

d» The design should provide for cost-benefit analyses , develooment 

of instrumentation, field testing and replication phases. It should 
specify check points for rcaualysis of needs and assessment of 
progress. Accountability procedures shot|ld be worked out. 

e. The agencies responsible for each segment should be specified 
and all plans should be presented to the agency for approval.- 

f* The actual investigators should be brought into the planning at 
the appropriate tJrne, 

Structure 

a. ;Kach agency should be responsible for the administration of the 
segments of the joint effort for which it has accepted the 
responsibility and deal directly wi th the <lnves tigator ^ f or 
initial data collection and monitoring of that segment. 

Opinion on centralized administration for coordination and data 
integration ranged from having it located in one member agency, 
to having it carried out by a contractor^ to iiaving tha Secretariat 
perform liaison functions, 

c. Panel should receive periodic reports and review and monitor tlic 
overall of fuLL.. May want a Committee with rotating Panel member*- 
ship for intermediate reviews at critical points. 
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All agencies snid that i.i: was likeJy that contributions to a Joint 
^effort > t'itlier Llu'oiiv;h cinil act vn' ili >o]i»;oi n)v vn'otK in trie a^,cncY or by 
the agency's, contract i wx-j work v;ould Vk' possible. One said 
ratlier than the lattej* arrangenii'nt Ills agency would prefer the total 
project be given to aii outside contractor. ^ 

5 • Ins t ^u."ie^n t n t io^ 

Develop clinical assessment techniques, l*o,, observations and inter- 
viewing. Use Jongiludinal cohorts of overlapping age groups to 
cover wide age range in shorter time period. 

10. Fmidlng^ 

Review processes vary from agency to agency with perhaps the iTiost ' 

stringent formal procedures found in NICHD and NIMH where a National 

Advisory Council tnust approve all grants for scientific inerit. In 

0?> agencies, vViile there are review procedures in most cases, and required 

Commissioner approval, staff rnenibers play a major role in project 

selection. The procedures range between these extremes in otiier 

agencies. 

(The responses of individual agencies appear in Appendix A.) 
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Tonlatlvc' Rosoarcli Plans SuuFl^^J^ted by Agency Interviews, Proscnited 



A. Key fKlcmcniLe; of Overall Planning; and Evaluation 

1. Statciuent of goals of the research effort, taking into considera-^ 
tion £>ocjal trends, political priorities, research needs and 
agency objectives. 

2. Selection of alternative interventions aimed at acliieving the 
goals. 

3. Conducting of feasihiHty studies to determine v;liich alternatives 
are most promising. 

4. Specification of clieck points for assessnient , and description 
of reporting and r;onitoring procedures. 

5. y^esignation of assessment instruments (including those whicli 
need development). . 

6. Description of a plan for implementation of sviccessful inter- 
ventions. • ^ 

Tlie above planning steps should be carried out by: (check one) 

' ■ ■ ■ % ' 
one agency which is a Panel member 

the Panel ' 

Panel Committees 

a contractor with Panel acting as advisor and monitor 

other (name) 



B. Procedure for Developing any one Longitudinal/Intervention Study 

(The letters P,A,C,S stand for Panel, Agency, Contractor, Secretariat 
and are included so that Panel members may indicate their preferences 
for the group best suited to carry out each step of the procedures 
described below.) 

■9 

P A C S 1. State objectives of the project or program, indicating 

the change in behavior expected in a particular population. 
(To be submitted fcr agency review and approval.) 

P A C S 2. Describe proposed research population in terms of tlie 

objectives. (Use existing agency data wheijcver possible, 
for example, tlic Follow Tlirouglr evaluation data or the 
OKO. demographic data on tjic i>oqr.) 
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I' A C S ■ 3. i\::nn;ine ayM-n(*y iuvit^arch projects to tliscover pcTlineiil " 
coniploiCHl r4nd ongoin^^ i nifirvent ion rcscarcli, or basic 
rcKcnrcli ro latod to interventions. Take into account 
plrmnorl re:;earch eifortK. Suii;rv.?ri;^o findinp,s of com- 
pleted research and objectives of ongoing; research, 
(This task lias been partially coiiip] eted^by the Secre- 
tariat staff . ) 

P A C S Review research in the nonfederal sector to determine 

findinp.s and ongoing and p 1 anned nonfederal programs 
which are relevant to the Panel project or its coiviponents . 

P A C S 5, Combine information on Federal and nonfederal findings 

and efforts to suiinarl^^e research gaps , taking into account 
both results and ongoing, or planned research. 

P A C S 6. Determine wliich agencies are best suited or prefer to 

conduct needed research in various areas as shovjn by the 
above analysis. Planning and providing fot the su;^>port 
» of additional new research may be necessary. (Submit 
for agency review and approval.). 

P A C S 7. Design research projectji or segments as determined by 
need and agency preferences* (Nay want to involve 
researchers themselves at this point.) 

p ^ ^ g g Conduct, research projects ainied at. developing longitudi^ 
nal/intcrventions to achieve stated goals, or aitned at 
discovering knowledge bearing on these interventions and 
objectives. Model devel^opinent includes testing with the 
research population and revision until research objec-. 
ttves are met. 

r ■; C S 9. Plan for replication of a longitudinal/Intervention in 

other than the reV>earch setting to standardize it suffi- 
ciently for broader ai>j3lication with similar populations. 

P A C S 10. Conduct replication studies and make necessary adjust- 
ments and revisions. ■ \ 

P A C S 11. Development of assessment instruments. 
9 * 
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C» Procedure for Administration and Monitoring 



P A C S !• AdininistraLlon of each corapouGnt research project 
or segment, 

P A C S 2* Cul.lcction of data from cotiponont project (direct 
contact with lnvestl[;ator:i) and the preparation of 
pro[^re^s report's on each project* 

P A C S 3, Site visits and monitoring/ of each project. 

P A C S Liaison, coordination of effort, exchange of infer- 

nation pertaining to component projects, between 
participant j np, agencies . 

P A C S 5. Collection via the sponsoring agency of information on 
component projects and integration of data* 

P A C S 6. Preparation of pro^^ress repor|s containing integrated 
information from the compoiien}: projects. 

P A C S 7, Reviev^ of progress reports and other reporf'i^ on the 

overall project for monitoring purposes on i periodic 
basis* (More than once a year.) ' 

g 

P A C S 8*. Evaluation of the overall project on an annual basis> 
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Possible r.rcu;ninf\s for Fs^seardj IM'ojoctr; Acconling to 

_ _ Present or J\l anneal Ai!.e)K:y J'mpiinsos ' _ ^ _ _ 

; (I'rom a^^ency interviev;s and oliicial sLatemeaLs of objectives) 



Kinds of Into rvent ion 


NICflD 


NTMd 


MCI IS 


SRS ^ 


OCD 


OKO 


OH 


oAsrr 


Cpmprehonsi vo cluld care. 




X 






X 


X 


X 


X 


Pros cl lO o 1 lui uc a t i on / 
clay care 




X 


— 




X 


X 


X 




Elonientary education 














X 




TGlevi,sion N 





X 




X 


,:X 




X 


X 


Family 


X 




X 


X 


X 




Parents 


X 


X 


X 




X 


X 


X 




Teenage parents 






X 


X 


X ^ - ' 




X 




Peers 


















Paraprof essionals 




X 


X 




X 


X 


X 




Community programs/ 
services 


X 


X ' 


— — 




X 




: X 


X 


X 


Advocacy 




X 






X 




X 




Delivery systems 






X 


X 






X 


X 


Institutions/ 
professions (not 
traininjg) 




X 




X 


X 




X 




Health & nutrition 


X 


X 


X 


X 










Diagnosis and , 
evaliiation 


X 


X 










X 




MedicaJ /clinical 
treatment 


.X 


X 










VA'A\ 
X 




Ileredi tary/ genetic 


X 




X 












"Assessment tecliniqnos 
and test dcvelopr.ent 

- ,., ... , .„ 


X 


X 


X 




X 




y 
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TABUrjJ 

Agency I'esoarclr Concerns by Kin d of Population ,. 



Kinds of Qiildren 


NICHl) 


NIMH 


V 

MCHS 


SRS 


OCD 


OKO 


OE 


1)1 s n d van t ag^e d (poor) 




X 




X 

= v 


X 


X 


X 


il'^IL^^iS^LH?^'^' (physically, 
emo':ionaily , intellec- 
tually, mentally handi- 
capped) . 


X 


X 


X 








X 


Vulnerable (adopted, 
foster, ncglecl;ed, 
abused or Institu- 
tionalized) 

\ 








X 


X 






Normal 


X 


X 










X 


Fetus or neonate 
(Prenatal or perinatal) 


X 




X 








. - '- _ ^ 
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Agency 'Research }iJ:ill,t£L!i?^?. In ' I^^'^J^ly Childhood 
^ bv kind of Int:er<ron'tion 
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1. Comprehensive child care: NIMli/OCD, GEO, OE, OASPE 

2. Presc'liool' education/day care: KIMIl, OCD, GEO, OE 

3. Elementary' education : GE ' / ^ . ^' - 

6. Television: NIMH, OCD, OE, GASPE . - . 

5. Family: NIMH,,3RS, OCD, GEO, GE.. / « 

6. Parents (mother 'and/or father) : NICHD, NI^Q1, MCHS, 
GCD, GEO, OE • 

7. Teenage parents: MCHS, SRS, CCD, OE 

8. Peers: not indicated as a ir.'^jor concern in any agency 

9. " Paraprofessionals: NIMH, MCHS, OCD, OEO, OE 

10. Cdnmmity programs/services: NICHD,' NIMH, SR^, OEO, OE, OASl'E 

11. Advocacy: NI^^1I, OCD, OE . 

12. Delivery systems: MCHS, SRS, OE, OASPE 

13. Institutions/professions (not training) ,:i,. Nltfli, SRS, OCD. 

OE , 

14. Health and nutrition: NICHD, NIMH, MCHS, SRS ' 

15. Diagnosis and evaluation: NICHD, NIMH, OE 

16. Medical/clinical treatment: NICHD, NIhDl, OE (BEH) 

17. Hereditary/genetic ! NICHD, MCHS 

.18. Assessment techniques and test development: NICHD, 
Umiy MCHS, OCD, OE 



TABLE, IV 



Agency Resenrcli P^p}i^a s e s i n E a r 1 y Childhood' 
^ by Kind of Population 



l;.. Disadvantaged (poor) Children : NIMH, SRS, 
OCD, OEO, OE 



2. Handicapped Children (physically, emotionally, 
Intellectually, mentally handicapped) : NICHD, 
mm', NCHS, OE 



Vulnerable Children (adopted, foster, neglected, 
abuqed, institutionalized children): SRS, OCD 



'4. Normal Children (those who are noc in the above 
categories): NICHD, N^^0^ OE 



5. Fetus or neonate (includes prenatal or perinatal) 
stages) : NICHD, MCHS 
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WORKING PAPER 



» Summary of Each Agency Interview 

(The opportunity to expand or change this 
I information will be provided each agency) 

I ^ . :' : 

. ..- ■ - ■ . ...... 



1 . Other Agencies 
(Tlxe other agencies it is appropriate for any one 
agency to \;ork with; kinds of help needed from othor 
agencies) 



BEH, MCHS, NIMH 



NICHD, OCD, MCHS 



NIMH, NICHD, OCD 
OCD, GEO 



All agencies 



Exchange information on testing, curriculum, use of consul- 
tants, Interaction between preschool and elementary school 
personnel} all agencies 



NIMH, NICHD^ OCD, GEO 



OCD, GEO, NCERD<. Follow Through needs more health data^ needs 
to know how to understand and use health services of the 
community . 



GEO, GCD, Follow Through. 

OE.^ BFil> NCERD, Follow Tlirough, SRS, bcD 

All agencies 



2. Rasic V Applied 
(Links in agency research that could be inade with basic 
(or applied) research) 



Much NICHD basic research has a practical aspect; studies 
interventions and techniques for all aspects of child 
development and growth; mental retardation studies have 
pragmatic concerns. 



Translate basic findings of NICHD and NIMH into health and 
nutrition programs, 



Follow Through is a natural setting for testing the theoretical 
findings of basic research; researchers can see what happens 
when their findings are applied in the field* 



3. Areas * 

(Rejiiearcb areas of most concern in the agency which tr.ay be 
suited to study in a joint project - includes gaps ) 



Physical growth, health, nutrition, cognitive and social 
development and particularly the interrelationships between 
two or more of these aspects; also mental retardation and 
abnormal development. 



Normal, disadvantaged, emotionally maladjusted child; social- 
emotional, cognitive, language development and their inter- 
relationships; family ecology of development, effect of 
interpersonal relationships of family: effects of TV; fotus > 
on adolescents as future parents, particularly on boys as 
potential fathers. 



Nutrition, health delivery systerrts, evaluation of health pro- 
grams, health issues in day care, teenage parents. 



Disadvantaged children; vulnerable children-neglected, abused, 
adopted, foster children; service delivery; teen-age mothers. 



Keed. more research in physical health and development and the 
interrelationships between psychological and physical develop- 
ment, and more studies ojn the effect of social milieu of families 
institutions - interactive effects of surrounding environment. 
Strong areas are in cognitive and psychological development 
and interventions for disadvantaged and vulnerable children. ' 

Disadvantaged; ,see BEH, Follow Through, NCERD below 



Hahdicapped children's early education, comprehensive child 
care for handicapped, learning disabilities, handicapped dis- 
advantaged children, delivery of services. 

Dissemination of data to other researchers and child prac- ^ 
tltioners; low-income and other childr.en; preschool education 
and cdmprehensive child care. ' 
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3, Areas (cont . ) 



NCERD Regional labs -r curriculum development for kindergarten; 

NPECE - aiming at development and integration of infant, 
toddler, preschool and early elementary education models; 
bilingual and intercultural education; individualized and 
computer-assisted instruction; home-school linkage, 

OEO , Parent-infant Intervention; cost-benefit analyses of parent- 

home vs; caretaker-institution pi^ograms • Cost-benefit impli- 
cations of different types of d^y care. Testing and documenting 
the process of developing replicable program models and materials. 



Other research areas currently being emphasized in the 
agencies arc listed in the paper; ^ Broad Agchcy Goals 
and Agency Research Objective^ -for^FY 1972, 



^k/ Projects^ 

(Present projects of tlve ap^ency which might be use,ful in 
organizing a coordinated longitudinal/intervention study) 



Intellectual development of poor children > Heber in Milwaukee; 
id year study of effect of diet on child development in 
Guatemala. 



Total family stimulation^ a longitudinal study starting with 
infants to prevent intellectual retardation of development 
in children of poor families. 



ETS study jLally study > Caldwell study and the Planned 
Variations study with Follow Through are all longitudinal 
studies . , 



Follow Through longitudinal evaluation; National. Cente'rVf or 
Educational Statistics longitudinal study; Sesame Street 
study of effects of TV. ' 



Jordan's St. Louis study; University of Minnesota study, 
following retarded children of Perinatal study; some of the 
70 early education projects; the Deutsch study, joint-funded 
with Nllffl; advocacy centers, joint-funded with NIMH. 



Longitudinal evaluation of nAtlonal Follow Through program % 
at least 7 years. Longitudinal study of Head Start/Follow 
Through Planned Variations^ 

DARCEE preschool model; Syracuse open environment model * v 
Parent and Child Development Centers 



;See projects described in earlier Secretariat papers, 

* Previously prepared papers contain more complete listings. 
See Appendix B. 



5. Data 

(The agency data presently available that could be 
useful for planning longitudinal/intervention research) 



"Tests and Measurements in Child Development - A Handbook", 
NIMll-funded book containing collection of tests on child 
developinent • 



The already existing complex data base of Follow Through can 
be used by the Panel; a variety of data can be collected for 
the Panel (or any one agency) free of charge; data deals with 
low-income and other children, and includes parent interview 
Information, classroom observation information, site evalua- 
tions, teacher and aide interviews, pupil tests, data on 
training, and reports on technical, procedural and other sub- 
stantive Issues. Could be used for substantiation of present 
research or kick-off for new research. 



Demographic data on disadvantaged population. Programs and 
materials for PCDC's, to be tested for replication. 



I 
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6^ Planning 

(Poss.n)le methods for synthesizing the A>nriou?? agency 
inputs into a viable intervention/longitudinal research 
design - conceptualisation and planning.) 



NICHD Subgroups of Panel should meet to work out details of research 

design; Panel members must be involved in planning in order to 
avoid rejection by agency; after plan is made and objectives 
clearly stated, send tenative proposals for joint effort for 
review by each agency. 
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NIMH Research design should take into account ^'critical stages'\ jtime 

points at which changes in the plan might need to be;made bejcause ^ 
of staff, funding or priority changes; cost benefit Studies |should 
be conducted to determine feasibility and productivity of different, 
kinds of interventions. Include normative studies in test develop- 
ment in Panel project and contract work out to specialized groups. 
Investigators themselves must participate in the planning of th^ 
actual research. ♦ r 

MCHS Meetings with agencies with common interests to exchange infor- 

mation (NICHD, NDfll). 

SRS Need work/group assigned by the Panel to develop grant or contract 

•guidelines and objectives. Should hire consultants to design 
*^'plan for/ joint longitudinal study* 

OCD Planning of design should be contracted out; perhaps a year's 

planning grant. Panel should specify objectives, preferably 
by having 'reports prepared for them, to be reviewed in small 
. groups and then to be considered by Panel as a whole. Plan 
should include feasibility and replication phases. Need a 
carefully designed experimental study to be most useful; we 
should look at the developmental growth curve for different 
processes and pinpoint optimal points for Intervention; inter- 
ventions should be designed and orchestrated for the most 
/ effective impingement at these critical points (we know what 

^' these points are from previous research) • Such an approach 

would represent a^conceptual breakthrough with real sclen- 
, tiflc stature and merit. For Panel project: formulate 
questions clearly and see what information we already have, 
utilize available data first; then see if ongoing projects 
can be augmented to collect the data required; if^need a 
new study, take cohorts in 3 year segments to cover wide 
^ ' age range; include longer-range studies only as last resort. 

Should be relatively small'study» vhicb is better for track- 
ing Subjects and for measurement. ' . 
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Plnn nlng(cont . ) 



Get OE program people together to talk, about joint, funding 
and the needs of the various agencies and what they can 
contribute. Get subgroups of Panel together to talk about 
objectives and contributions of each. 



Get experts together and dialog about state of the art in ' 
preventive intervention. Talk- with nonfederal funding sourqes: 
develop plans so that better sets of alternative interventions 
are developed with t.hese sources; investigate the Foundation 
Library Center for information regarding foundations' research. 
Have central point of information exchange for agencies to use 
to^ op tiniize planning. Have periodic check points to determine 
which segments and studies are meeting predetermined objectives: 
discontinue ineffective ones, start new segments as needed. 



7. Structure 

(The kind of structure that might be set up to launch 
and/or maintain an interagency intervention/longitudinal 
study) 



Relevant part of Panel project could be written into contract 
program as RFP. Send it to Panel for review. Funding agency 
should deal directly with contractor and monitor work; administrative 
locus for joint effort whould be in one agency, i.e., administration 
of funds can be located elsewhere after contract review; Panel 
receive progress reports and review work. 

Should start small; bring together selected researchers to assist - 
in planning several interacting projects; participants would 
agree to joint protocol, i.e. following identical procedures. 
Panel should provide framework for intei>action and monitoring ^ 
and the resources to process and analyze data; the administration 
may be subcontracted to a private source; another agency should 
not be the administrator; must have feedback process to handle 
problems and to review and monitor work, i.e., check points and 
reports to Panel. a 

One agency should be lead agency for administration; Panel 
committee with rotating membership should do monitoring. 



Panel^s role should be to advise, review and monitor, but not 
to conceptualize. Should have series of formal Interagency 
agreements committing agencies to joint longitudinal research 
on individual projects (as proposed for Planned Variations study). 



Administration of individual components of group effort should 
be administered by the agency funding that segment; P^nel should 
be responsible for monitoring; Secretariat should provide clear-, 
inghouse and liaison. Group effort should not be administered 
by one member agency; then it is not a group effort* 

Should contract oUt planning, data collection, administration, 
; and liaison; gioup of Panel members should monitor, with reviews 
by the entlro Panel. V 
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Stfucture (coiit.) 



Follow Make use of Folicv; Through - already funded ($60 million) 
Through ' ongoing and liked; a well-known example o£ successful 
compensatory education. ' ; 

OEO Hire a funding manager who lets contracts to multiple sites 

on a multi-year basis; ' funding renewable on favorable review* 
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^' Cont ributions 
(The contribution an agency might make to an Intervention/ 
longitudinal research design in terms of agency strengths, 
interests, and priorities) 



NICHD NICHD can fund jointly on grants if they fit with agency program; 

can fund jointly on a contract basis also; five-year contrast 
with renewal contingent on^ performance is possible • ' 

NIMll Child mental health is a priority ar,ea of expanding Interest and 

agency officially recognizes the Importance of longitudinal 
research;* also the agency approves and supports joint funding; 
therefore, any joint-funded, ongoing project making progress, 
would probably be refunded^ Agency wants to take, an active role 
* in joint projects studying children. 

- 4 / 4 

MCHS'*' Joint funding would require special in~house consideration* 



SRS 



Agency has supported longitudinal research in the past; new 
agency strategy is putting stress on short-terra research and 
older children. Also the only discretionary funds in the agency 
are in research' and development, so they are subject to many 
demands . However, joint funding could be done it the work fit 
into the agency's R&D plan and could be sold to *the SRS 
Commissioners for approval. * 



OCD 



Have precedents for joint funding** and commitment tp the conduct 
of* longitudinal research • 



OE 



Make use of ongoing studies as much as possible, Follow Through 
a good example; contract new work as group plan requires • Joint 
'jEunding no problem, can draw funds from several agencies. 



: Follow 
Through 



Joint funding presents no problems; no committee review process. 



OEO 



Supports longitudinal intervention research. 



^* ^ n s (: r un^en t a tion 
(Suggestions regardiag instrumentation for. assessment) 



Panel should fund nomiative studies on existing child development 
tests that show greatest promise of effectiveness. 



Use clinical assessifent techniques: observations and Interviews 
with parents^ teachers, peers, children, others, Must have 
money to train people for this as well as carry it out. It is 
expensive in time and personnel* 

■ ■ ■ \ 

The problem of developing measures in the social--emotlonal cjpmaln 
and for various ethnic groups is primarily a conceptual one. 
Knowing what questions to ask and how to Interpret data are the 
major difficulties; need trained people for this. There are many 
techniques for collecting; information on small groups* Use 
cohort studies to cover wider age range In shorter time. 

Use mode; of National Center of Health Statistics (NIMH) for 
collecting health dala-they use luoblle vans with standardized 
equipment and trained interviewers to collect health data. 



•^PENDIX B 



^ a' 

Interagency Panel Materials Prepared to 
Assiat in Planning a Joint Research Effort 



1 • A Prelimin a ry Report on th e Present Status ^ 
and Fut ure Needs in Longitudinal Studies in 
Early Childhood Research and Demonstration . 
Lazar> Joyce B., January > 1972 • 

2» * Early Ch ildh ood Research and Development 

Needs » Gaps and Imba lances ; Overview ; Chapman, 
Judith, Ph.D. , February, 1972. 

A Working Paper on Intervention/Longitudinal , 
Studies,. Grotberg, Edith, Ph.D., February, 1972. 

A> EarjLv Childhood Research and Development: Needs 
and ^ps in Intervention Studies, Within a Longi- 
tudinal Frafriework._ La^ar, Joyce B. and Judith 
Chapman, Ph.D., March, 1972 ' 

5. Broad Agency Goals and Agency Research Obiectives 
* for FY 1972. Sj^arcy, Ellen, December, 1971. 



